Logarithmic susceptibility and optimal control of large fluctuations 
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We analyze the probabilities of large infrequent fluctuations in systems driven by external fields. In a broad 
range of the field magnitudes, the logarithm of the fiuctuation probability is linear in the field magnitude, 
and the response can be characterized by a logarithmic susceptibility. This susceptibility is used to analyze 
optimal control of large fluctuations. For nonadiabatic driving, the activation energies for nucleation and 
for escape of a Brownian particle display singular behavior as a function of the field shape. 
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PACS numbers: 05.40. +j, 02.50.-r, 05.20.-y 

It was pointed out by Debye |l[] that systems with co- 
existing metastable states may strongly respond to the 
driving field through the effect of the field on the prob- 
abilities of transitions between the states. For classical 
systems, the transition probability W is described by the 
activation law, W oc exp(— i?/fcr). Even a relatively 
weak ac field h, for which the change of the activation 
energy AR oc /i is much less than R, can strongly affect 
W provided \AR\/kT is not small. This effect has been 
investigated for various systems and has attracted much 
attention recently in the context of stochastic resonance 
|||. For |Ai?|/fcr > 1 the modulation of W becomes ex- 
ponentially strong. So far this modulation has been ana- 
lyzed for adiabatically slow driving, where the change of 
the field over the relaxation time of the system is small 
and fluctuational transitions occur "instantaneously" , for 
a given value of the field (cf. ||^). The physical picture of 
transitions is different for nonadiabatic driving. In this 
Letter we provide nonadiabatic theory of large fiuctu- 
ations in spatially extended and lumped parameter sys- 
tems. We show that the exponentially strong dependence 
of the fiuctuation probabilities on the driving field can 
be described in terms of an observable characteristic, the 
logarithmic susceptibility (LS). 

The notion of LS and the way to evaluate it are based 
on the idea of the optimal fluctuational path. This is the 
path along which the system moves, with overwhelming 
probability, when it fluctuates to a given state or escapes 
from a metastable state. The distribution of fluctuational 
paths to a given state peaks sharply at the optimal path, 
as first noticed in 

Optimal paths in lumped parameter dynamical sys- 
tems driven by Gaussian noise have attracted much the- 
oretical interest Q and were recently observed in exper- 
iments The notion of an optimal path applies also 
to continuous systems. Time-dependent fiuctuations of 
the order parameter ?7(x) were discussed in [Q, and its 
optimal paths were considered in |p|,pi. Optimal paths 



are "fiuctuational counterparts" of dynamical trajecto- 
ries: they map the problem of large noise-induced fiuc- 
tuations onto the problem of noise-free dynamics of an 
auxiliary system (this dynamics depends on the proper- 
ties of the noise driving the original system, see |^). 

We will first consider optimal paths and logarithmic 
susceptibility using as an example systems with a non- 
conserved order parameter (7j(a). In these systems, fluc- 
tuations are described by the Langevin equation 
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dt Srj (x, t) 
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with the free energy 



F[r]] = j 



^{Vvf + V{r,)-h{^,t)f^ 



(2) 



where V{ri) is the biased Landau potential. 

The probability density for the system to fluctuate to 
a state rjf = r]f{x) at a time i/ is described by the ac- 
tivation law, W[rif;tf] oc exp {—R[rif;tf]/kT), with the 
activation energy given by the solution of the variational 
problem 



R[i]f;tf] = min— [ dt' I dx' 



(3) 



Here, the minimum is taken with respect to the paths 
?7(x',i') that start from the stable state 77st(x, i) at t' 
— cx), and arrive at the final state f7/(x) for t' — tf. We 
consider pulsed or periodic driving fields h, in which cases 
the state ?7st is stationary (it provides a minimum to 
V{r])) or periodic, respectively. 

Eq. (jsj) defines the action for an auxiliary Hamiltonian 
system, with the Lagrangian given by the integrand in 
(^). Extreme paths of this system that minimize R are 
optimal fiuctuational paths 77 (x, t) of the original system 

(HI). 
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In the absence of driving the system (Q) is in thermal 
equilibrium, and the activation energy is i? = i?'"-* = 
^("^[77/] — F^^'>[ri^^^] (the superscript refers to the case 
h = 0). The optimal fluctuational path rj'-^'' {x,t\rif ,tf) 
to the state 77/ is the time- reversed path of ([|) from this 
state in the neglect of noise, Ty*^"^ — SF^^^'/Stj. This sym- 
metry with respect to time reversal is a generic feature 
of systems with detailed balance . 

To the first order in h, the field- induced change of R is 
given by the term (x h in the integrand in (||) evaluated 
along the unperturbed optimal path 77^"^: 

R^'\vf;tf] = r dt' f dx'x{^',tf-t'Mh{x',t'), (4) 

J —QO J 

x(x,-i|77^) = -77W(x,t|77/,0) it<0). (5) 

The quantity x describes the change (x h oi the log- 
arithm of the probability density to reach the state 
77/ = 77/(x), AlnVF sa —R^'^^/kT. This change may be 
large, and x may be reasonably called the logarithmic 
susceptibility (LS). Like standard generalized suscepti- 
bility, LS has a causal form: the probability to reach a 
given state at a time i/ is affected by the values of the 
field at i < tf. The LS x(x, — t\r]f) becomes small 
for tf — t larger than the relaxation time of the system 
trci- We note that Eq. (||) suggests how to measure LS 
for various states 77^ (x). 

Of special interest are effects of the field on the prob- 
ability of escape from a metastable state of the system. 
For a system (|l|) escape occurs via nucleation. For h — 
the critical nucleus 77c? (x — Xc) is the unstable stationary 
solution of the equation 77 = —6F^^'>/6ri (the saddle point 
in the functional space), and the position of the center 
of the nucleus Xc is arbitrary. In forming the critical nu- 
cleus the system is most likely to move along the optimal 
path 77^°ci(^ - Xc,t - tc) = 77(")(x - Xc,i - tc|»7c?\oo). 

The optimal nucleation path 77^^^^[ is a real-time in- 
stanton solution of the variational problem (ra) for /i = 0. 
It starts for t ^ —00 at the stable state 77^!^'' and ap- 
proaches the state 77c?'' as < ^ 00. It is important 
that, as in the case of "conventional" instantons [0, 
l''?nuci(^ — Xc, t — tc)\ is large only within a time interval 
\t — tc\ ^ irei centered at an arbitrary instant tc- 

Translational and time degeneracy of the optimal nu- 
cleation paths ?/nuci(x — Xc, t — ic) is lifted when the sys- 
tem is driven by an external field. One can show that 
the optimal path still starts from the vicinity of the 
metastable state 77st and asymptotically approaches the 
critical nucleus 7/cr- In the case of a pulsed field, these 
states are just r]"^ and 770?, respectively. For weak peri- 
odic field, both states are periodic with the period of the 
field. 

Lifting of the degeneracy occurs because the criti- 
cal nucleus is an unstable state. For small h and fi- 
nite \t — tc\, the field-induced correction to a solution 



77j^j°'[,[(x — Xc, t — tc), with given Xc,tc, remains small. 
However, generally the correction has an admixture of 
the solutions of the unperturbed Euler-Lagrange equa- 
tions which go away from the unstable state exponen- 
tially in time. Therefore the whole solution diverges from 
the unstable state exponentially as i — > 00. Only for one 
solution (or one per period of the field, in the case of pe- 
riodic field) the divergence does not occur, and this so- 
lution is close to ''7nuci(^ ~ ^c,tf — tc) with certain Xc, tc 
which are determined by the field. This situation is fa- 
miliar from the Mel'nikov's theory of a heteroclinic orbit 
in the presence of a periodic perturbation Jl2| . 

An insight into the problem can be obtained from 
the analysis of the Lagrangian manifold of the Hamil- 
tonian system with the action R[ri;t\ (^). This manifold 
is formed by extremal trajectories with the generalized 
coordinate 77(x, i) and momentum 7r(x, i) = 5R[ri;t]/ 5r] 
p^ . The optimal nucleation trajectory emanates, for 
t —* —00, from the stationary (or periodic, for periodic 
driving) state (7/st,7rst), which corresponds to the stable 
state of the original system (|l|), 7rst(x, t) = 0. For < — > 00 
this trajectory approaches the state r7cr (x, t) , TTcr (x, t) — 
0, associated with the critical nucleus. 

Taking account of the first-order correction to the ac- 
tion the equations for the first-order correction to 
an unperturbed extreme trajectory 77^°^ (x, t), tt^"^ (x, t) = 

i(0) 



77^"^ (x, t) take the form 



6R^ 



(6) 



^(1) ^ M(")77(i) 

M(")7;(i)(x,t) 

5 nu 

JO) 



d'x! - 



=i?(i)[77(0)(x,i);i]. 



52^(0) 



(x',i). 



(57/(x)(57y(x') 

The nucleation trajectory is close to an unperturbed 

path T^nuciC^ — Xc, t — tc) with properly chosen Xc, ic- The 
values of Xc, tc can be found by solving Eqs. (|^) near the 
critical nucleus, i.e. for large t, taking into account that, 
for the "correct" trajectory, the momentum tt'*'^ +7r'^^^ 
for t — > 00, while 77^-'^^ ri^ — 770? ~ h. 

The solution of (§) near the nucleus can be ex- 
pressed in terms of the eigenvalues A„ and eigenfunctions 
'0„(x — Xc) of the Hermitian operator Mc?^ = M^"^ ['7cr'']- 
The corresponding eigenvalue problem coincides with 
that for the dynamical equation (^ in the absence of 
noise, but the eigenvalues have the opposite signs. The 
operator Mc?'' has one nondegenerate negative eigenvalue 
Ao < 0, with the eigenfunction 

- Xc) = Coe-^°(*-*^)77f^°j^i(x - Xc, i - tc) (7) 

(here, t — > 00); a degenerate zero eigenvalue Ai = 0, 
with the eigenfunctions which are proportional to the 
components of the vector V77ct^ ; and positive eigenvalues 
A„ > 0, 71 > 1 P,p|. 
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It follows from Eqs. @, @ that, for R'-^'^ evaluated 
along the path ry^^'J,;, the matrix element of SR^^^/Sr] on 
ipo is equal to ^(Xc, ic) exp[— Ao(i — tc)]- It diverges for 
t oo unless A = 0. It follows also from (|^) that, 
in order for tt^^^' to go to zero for t oo, the matrix 
elements of SR'^^ySrj on dr]i?/dxi should be equal to 
zero as well. The condition that the matrix elements 
should vanish is a consequence of the unperturbed system 
being "soft" in the functional-space directions ■00 and 
drji? /dxi which correspond to the shifts of the nucleation 
path along t and x. Taking account of Eqs. (^), (Q), this 
condition can be written in the form 



R 



9x, 

(1) = 

nucl 



dt I dxxnuci(x - Xc,i - tc)^(x, i) 



(8) 



Xnucl(x - Xc, t - tc) = -??iuci(x - X^, t - tc) (9) 

Eqs. (H) determine Xc,<c for the optimal nucleation 
path. They may have several roots. The physically rel- 
evant root is the one that provides the minimum to the 
field-induced correction to the activation energy of nucle- 
ation According to Eqs. (| 



R 



(1) 



min i?, 



(1) 

nucl 



(Xc,ic) 



(10) 



Eqs. (^) - (|T^ provide the nonadiabatic theory of nu- 
cleation rate. They have a simple physical meaning: in 
the presence of a time- and coordinate-dependent field, 
the optimal fluctuation finds the "best" time tc and place 
Xc to occur. For thermal equilibrium systems, the cor- 
rection is given by the work done by the field along the 
optimal path. 

The correction i?^uci linear in the magnitude of the 
driving field. However, the superposition principle does 
not apply: the correction from a sum of the fields is not 
equal to the sum of the corrections. This is because the 
minimum in Eq. ([l^) is a nonlinear operation, and the 
instant tc and the position Xc of the optimal fluctuation 
are found in such a way as to minimize R[1^c\ ^'^^ 
total field, not for its constituents, and in particular not 
for each of its Fourier components. 

We note that the dependence of R'^^^^x shape of 

the field may be singular. With the varying interrela- 
tion between the Fourier components of the field there 
occurs switching between different coexisting solutions of 
Eqs. (^), i.e. from one minimum of R^^^^ci ^'^ another, with 
different Xc,ic (cf. inset to Fig. 1). 

For pulsed fields, R^^^^^x always non-positive: if the 
pulse effectively lowers (dynamically) the nucleation bar- 
rier (i.e., < 0), the optimal fluctuation occurs where 
and when the field is "on" , otherwise it follows from 
Eqs. (||), ( p^ ) that nucleation is most likely to occur 



where there is no field. The term R)-^^c\ '^an be pos- 
itive only provided the field has an appropriate time- 
independent (dc) component. 
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FIG. 1. Reduced absolute value of the logarithmic suscep- 
tibility for nucleation (;(k, f2) (11) in the case of a weakly 
asymmetric potential V. Inset: the correction R^^\tc) for 
nucleation in a uniform field h = cos p^t + 1.3 cos{2p^t — 0.1). 



Analytical results for the logarithmic susceptibility for 
nucleation Xnuci @) can be obtained in limiting cases, 
in particular for a weakly asymmetric double-well poten- 
tial V{r]) = luT]^ - ir7/2 _ Ht], \H\ < r^/^u'^/^. The 
critical nucleus in this case is a thin-wall droplet of a 
nucleating phase [jll],^. The optimal nucleation path 
corresponds to the increase of the radius of the droplet 
p until it reaches the critical value pc, and is described 
by the time-reversed collapse of the droplet in the 
absence of fluctutions. The resulting expression for the 
Fourier transform Xnuci(k, w) of the logarithmic suscep- 
tibility x,iiici(x, t) is of the form: 



Xnucl(k, w) 



6i? 



(0) 



-9 {Pck,pluj) , 



(11) 



(the free energy of the critical droplet r!^^c\ 
given in 0,|I|). 

One can see from (^), (10) that, for a field of the 
form of a running or standing sinusoidal wave, h = 
/lo cos(kx — Lot) or ft, = ftocoskx coscji, the correction 
to the activation energy is R^^^ = — |xnuci(k, lj)|/io. The 
susceptibility |xnuci| as given by ([ll| ) is shown in Fig. 1. 

The notion of logarithmic susceptibility makes it pos- 
sible to formulate, in fairly general terms, the prob- 
lem of optimal control of large fluctuations by an ex- 
ternal field, or equivalently, of cooperation with fluctu- 
ations in bringing the system to a given state by a field 
which is much weaker than the one that would be nec- 
essary in the absence of fluctuations. In optimal control. 
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one has to minimize or maximize the activation energy 
^[Vf'itf] = @ of reaching a state 77/ in the 

presence of the field h subject to a given constraint on 
the field, i.e. to a given value of the penalty functional 
G[h] — Q (for example, the energy in the field pulse). 

The optimal activation energy i?opt and the corre- 
sponding optimal control field /lopt (t) can be found from 
the variational problem for the field 



S[R[7]f;tf\h] + X{G[h]-g)]=0. 

Ropt — Rivf^tflhopt] 



(12) 



where A is the Lagrange multiplier. 

For various optimal control problems in physics and 
chemistry the penalty functional G is quadratic in h 
. Then, for comparatively weak fields where the field- 
dependent term in the activation energy i? (^ , (H) is lin- 
ear in h, the problem (12) reduces to a linear equation 
for h. We give the solution of this equation for opti- 
mal control of the nucleation rate by a spatially uniform 
pulsed field h{t) with a pulse duration t, and the penalty 
fimctional is G[h] ^ (1/2) dth^{t): 



nl/2 



, k(t) — max 



dtxHt-tc), 



X{t) = J dxxnuci{x,t), (13) 
hoptit) = -x(< - [2g/«(r)]'/' for < t < r, 

where tcm is the value of tc which provides the maximum 
to the function k(t) (13). 



nucleation one should consider the susceptibility for es- 
cape from a metastable state. 

In optimal control of escape of an underdamped Brow- 
nian particle by a pulsed field, the shape of the control 
field may change discontinuously with the varying pulse 
duration. This is related to the fact that the integral in 
the expression for k(t) may have several extrema for dif- 
ferent tc, and with the varying r there may occur switch- 
ings between different extrema (cf. Fig. 1). Respectively, 
the activation energy is nondifferentiable at such r, as 
shown in Fig. 2. 

The above approach, including the formulation of the 
optimal control problem in terms of logarithmic suscep- 
tibility, applies also to systems away from thermal equi- 
librium if the driving noise is Gaussian. The logarithmic 
susceptibility with respect to the field h can still be ex- 
pressed in terms of the optimal paths for h = 0, although 
the appropriate expressions differ in form from Eqs. (||), 
(I). 

In conclusion, we have provided the nonadiabatic the- 
ory of escape and nucleation rates in systems driven by 
time-dependent fields. The effect of the field on the prob- 
abilities of large ffuctuations has been described in terms 
of the logarithmic susceptibility. This susceptibility can 
be measured experimentally even if the underlying dy- 
namics of the system is not known. It has been used 
to formulate the problem of optimal control. We have 
demonstrated singular behavior of optimal modulation 
of the escape rate as a function of the parameters of the 
control field. 
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FIG. 2. Reduced correction K^^'^(r) (13) for optimal control 
of the escape rate of a Brownian particle in a cosine potential, 
q + 2Vq — sing = ^(t), for V = 0.04. Inset: the optimal fields 
(13) for the pulse duration r just below (a) and above (b) the 
switching value r ~ 4.6. 

The above results can be easily reformulated for sys- 
tems other than those described by the model (|l|) . In par- 
ticular, they apply to lumped parameter fluctuating sys- 
tems, including over- and underdamped Brownian parti- 
cles. For such systems, instead of the susceptibility for 
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